Learning of Temporal Sequence Processing by Neural Networks
نویسندگان
چکیده
منابع مشابه
Nonmonotone BFGS-trained recurrent neural networks for temporal sequence processing
In this paper we propose a nonmonotone approach to recurrent neural networks training for temporal sequence processing applications. This approach allows learning performance to deteriorate in some iterations, nevertheless the network’s performance is improved over time. A self-scaling BFGS is equipped with an adaptive nonmonotone technique that employs approximations of the Lipschitz constant ...
متن کاملFuzzy Temporal Sequence Processing By Fuzzified Recurrent Neural Fuzzy Network
Abstrad A Fuzzijed TSK-type Recurrent Neiiral Fuzzy Network (FTRNFN) for handling furry temporal information is proposed in this paper. The inputs and oulputs of FTRNFN are fuzzy pattems represented by Gaussian or isosceles triangular membership functions. In structure, FTRNFN is a recurrent fizzy nefwork constructed from a series of recurrent fuzzy +then rules with TSK-t)pe Consequent parts. T...
متن کاملNeural net architectures for temporal sequence processing
I present a general taxonomy of neural net architectures for processing time-varying patterns. This taxonomy subsumes many existing architectures in the literature, and points to several promising architectures that have yet to be examined. Any architecture that processes timevarying patterns requires two conceptually distinct components: a short-term memory that holds on to relevant past event...
متن کاملSequence to Sequence Learning with Neural Networks
Deep Neural Networks (DNNs) are powerful models that have achieved excellent performance on difficult learning tasks. Although DNNs work well whenever large labeled training sets are available, they cannot be used to map sequences to sequences. In this paper, we present a general end-to-end approach to sequence learning that makes minimal assumptions on the sequence structure. Our method uses a...
متن کاملTemporal Processing Neural Networks for Speech Recognition
Application of the temporal processing neural networks (TPNNs) to the speech recognition is justified by the nature of the task. Indeed ASR is a sequence recognition problem and assumes incorporation of time into decision process. Static models treat elements of sequence as independent patterns, which is clearly unrealistic. On the other hand temporal processing nets, built on the basis of mult...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: IEEJ Transactions on Electronics, Information and Systems
سال: 1990
ISSN: 0385-4221,1348-8155
DOI: 10.1541/ieejeiss1987.110.3_112